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Abstract 

Recently Segev et al. (Phys. Rev. E 64,2001, Phys.Rev.Let. 88, 2002) made long-term observa- 
tions of spontaneous activity of in- vitro cortical networks, which differ from predictions of current 
models in many features. In this paper we generalize the EI cortical model introduced in a previous 
paper (S. Scarpetta et al. Neural Comput. 14, 2002), including intrinsic white noise and analyzing 
effects of noise on the spontaneous activity of the nonlinear system, in order to account for the 
experimental results of Segev et al.. Analytically we can distinguish different regimes of activity, 
depending from the model parameters. Using analytical results as a guide line, we perform simu- 
lations of the nonlinear stochastic model in two different regimes, B and C. The Power Spectrum 
Density (PSD) of the activity and the Inter-Event-Interval (IEI) distributions are computed, and 
compared with experimental results. In regime B the network shows stochastic resonance phe- 
nomena and noise induces aperiodic collective synchronous oscillations that mimic experimental 
observations at 0.5 mM Ca concentration. In regime C the model shows spontaneous synchronous 
periodic activity that mimic activity observed at 1 mM Ca concentration and the PSD shows two 
peaks at the 1 th and 2 nd harmonics in agreement with experiments at 1 mM Ca. Moreover (due to 
intrinsic noise and nonlinear activation function effects) the PSD shows a broad band peak at low 
frequency. This feature, observed experimentally, does not find explanation in the previous mod- 
els. Besides we identify parametric changes (namely increase of noise or decreasing of excitatory 
connections) that reproduces the fading of periodicity found experimentally at long times, and we 
identify a way to discriminate between those two possible effects measuring experimentally the low 
frequency PSD. 
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I. INTRODUCTION AND MOTIVATIONS 



Spontaneous (and stimulation-driven) synchronized oscillatory activity has been observed 



in many in vitro and in vivo experiments 

The understanding of spontaneous activity of in-vitro networks DO [ID is a pre- 
liminary requirements for the comprehension of the network behavior inside animal brain, 
where the dynamics is more complex due to the presence of external stimuli and of inter- 
actions among different parts of the brain. In particular, the understanding of the specific 
mechanisms underlying spontaneous spatio-temporal pattern of acti vity is important for the 
comprehension of brain activity, especially in relation with epilepsy [17[ , the central pattern 
generator systems, etc. 

Recently Segev et al. have done accurate long-term measurements of the spon- 

taneous activity of in-vitro cortical cells neural networks placed on multi-electrode arrays. 
The effect of external Ca concentration on the spontaneous activity has been studied. They 
observed, for a critical range of Ca concentration, periodic synchronized bursting activity, 
that fades away after about ~ 20 min. Periodic synchronized bursting is observed at ImM 
Ca concentration and not at higher (2 mM) and lower (0.5 mM) concentrations. Their obser- 
vations differ from prediction of current neural network models in many features. They try 
to model the phenomena performing numerical simulations of an integrate-and-fire network 
model with random connections. Adding (1) dynamic threshold and (2) activity-dependent 
synaptic connections, they reproduce much of the observed network activity, but do not 
obtain a complete explanation of the experimental results. For example, their numerical 
simulations capture the transition between aperiodic synchronized bursting versus periodic 
synchronized bursting when Ca concentration (and so model connection strengths) was in- 
creased, but they do not reproduce the transition from periodic synchronized bursting versus 
aperiodic activity observed experimentally when Ca concentration was increased over the 
critical interval. Moreover the experimental data show that the energy distribution over low 
frequencies has a broad band with power law decay that indicates the existence of positive 
long range time correlations in the sequences of bursts, this behavior cannot be accounted 
for by the Segev et al. model. The IEI distribution at 0.5 mM Ca shows a very long tail 
(tens of sees), decaying much more slowly that in the IF model. Finally, experimental re- 
sults shows that, after ImM Ca concentration was obtained, the high peaks of the PSD, 
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at first and second harmonic, become lower and lower with time, and after ~ 20 min the 
PSD is almost flat. These PSD features (in particular the behavior at low frequency and the 
changes that happen in time scale of several minutes) have not been explained by the model 
of Segev et al |2j , and as far as we know, until now the explanation is lacking. Patterns o 



spontaneous activity in cortical cultured networks were observed by other researchers 
Canepari et. al [8j observed transitions from asynchronous firing dynamics to synchronous 
firing dynamics when Ca2+ concentration was increased from 0.1. mM to 1 mM. 

Here we model a cultured cortical cells network using a Excitatory-Inhibitory (EI) Cowan- 
Wilson-like |13| model analytically tractable, which enable us to study the source of sponta- 
neous activity dynamics analytically. We analyze the macroscopic observable that describe 
the dynamics of the system as a function of the network parameters, exploiting effects of 
noise and nonlinearity. 

We show that some insights and a good agreement with experiments can be obtained 
including intrinsic white noise in the spiking-rate Excitatory-Inhibitory (EI) neural network 
model. The model is based on the noise-less cortical model introduced in a previous paper 
jj] by one of us, Z. Li and J. Hertz, which is able to imprint and retrieve oscillatory patterns 
when driven by noise- less oscillatory input (using a generalized hebbian learning rule). Here 
the model is studied to put in evidence its spontaneous activity and specifically the effects of 
noise on the dynamics are analyzed. The spatio-temporal patterns of spontaneous activity 
in our model is a consequence of the dynamics of the interacting excitatory and inhibitory 
units, and depends critically from the presence of noise and from the synaptic strengths of 
the EI network. 

The results we have found, although referred to the work of Segev et al. , are of more 
general interest, indeed they connect the behavior of in- vitro neural networks to the one of 
nonlinear subthreshold and overthreshold systems in presence of noise. 

The effects of noise in neural models is the focus of a lot of recent literature llSf, ll 



: rom the single FitzHugh-Nagumo system point of view 20] to the IF homogeneous networks 

k n 

19| or the phase- model coupled oscillators [18]. 



In section[H]the model is described, in sec IIHI analytical and numerical results are reported 
and in section IVTl there are discussions and conclusions. 
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II. THE MODEL 



Our starting point in modeling are the stochastic Cowan- Wilson-like EI equations |4l 113. 
Q] governing the state variables, modeling the membrane potentials, u = {ui, . . . , u^} and 
v = {t> 1; . . . ,vn}, respectively for the excitatory and inhibitory units: 

Ui = -aui - ^ H ij9v(vj) + ^2 J ij9u(uj) + Fi(t), (1) 

3 3 

■ ■ a/) ■ /••;(/). (2) 



The unit outputs g u (ui), . . . , g u (uN) and g v (v i), . . . , g v {yN) represent the probabilities of the 
cells firing (or instantaneous firing rates) where g u g v are sigmoidal activation functions that 
model the neuronal input-output relations, a -1 is a time constant (about few milliseconds, 
for simplicity it is assumed equal for excitatory and inhibitory units) modeling the membrane 
time constant, Jy is the synaptic connection strength from excitatory unit j to excitatory 
unit i, Wij is the synaptic connection strength from excitatory unit j to inhibitory unit i 
and Hij is the synaptic connection strength from inhibitory unit j to excitatory unit i. Since 
in cortical area pyramidal cells have long range connections to others pyramidal cells and 
to inhibitory interneurons, while inhibitory interneurons generally only project locally, we 
assume and Wy to be long range connections, and ify to be local. All these parameters 
are non-negative; the inhibitory character of the second term on the right-hand side of 
Eqn. (Q) is indicated by the minus sign preceding it. Fi(t) and Fi(t) model the intrinsic 
noise, respectively on the excitatory and inhibitory units, not included in the definition 
of u,v. In a (cultured) interacting neurons system noise can be due to several reasons, 
like thermal fluctuation, ionic channel stochastic activities, and many others. We take the 
noise Fi(t),Fi(t) to be uncorrelated white noise, such that ( F^t) ) = ( F^t) ) = and 
( Fiif) Fj(t') ) = T6ij5 t -t>, ( Fi(t) Fj(t') ) = FSySt-t'- Each such unit u^Vi represents a 
local assembly of pyramidal cells or local interneurons sharing common, or at least highly 
correlated, input. (The number of neurons represented by the excitatory units may be 
in general different from the number represented by the inhibitory units.) For reasons 
explained in the following, we choose the connection matrices J,H,W symmetric, apart 
from small random fluctuations. This symmetry does not imply symmetry of the total 

J -H 

connection matrix I I , indeed it is highly asymmetric, as well as the connections 

WO 



between excitatory and inhibitory neurons are still asymmetric in this scenario. 



A. Network connectivity 

Since the connectivity formation of the cultured system we want to model has grown 
randomly and spontaneously, we can reasonably assume that strength of each connection 
is a function only of the type of pre-synaptic and post-synaptic neurons (Excitatory or 
Inhibitory), and of the distance between them, plus eventually some random quenched fluc- 
tuations. Recent estimation of connectivity in in- vitro rat cortical networks has shown long 
range connections, with arborization of the neurons of 1.2 ± 0.5mm 2 [llj], such that each 
neuron was connected with about 600 nearby neurons. 

We will analyze two type of connectivity structures. 

• In the first case, each excitatory unit is connected to all the other units of the model, 
while inhibitory units only project locally. In particular, J and W are long-range 
matrices given by 

J l3 = j (l + e V lp)/N 

W l3 = W Q {l + erjW)/N (3) 

and the matrix H is local H i3 = h 5ij(l + erj^), where e< 1 and f]^ \ Vi^ are 
random quenched values, uniformly distributed between -1 and 1. When e = 0, the 
three connection matrices commute each other and share a complete set of eigenvectors. 
In particular the principal eigenvector £ = (l/\/jV, . . . , 1/yN) has eigenvalues jo, Wq 
and ho, while the others N — 1 eigenvectors have eigenvalues 0, and ho, respectively. 
When e > 0, the vector £ = (l/y/N, . . . , 1/y/N) will still be an eigenvector of the 
connection matrices, apart from corrections of order 0(e/y/~N). In this paper we take 
e = 0, in a following paper we will investigate the effects of order e and e 2 (numerical 
simulations with small e ^ give results qualitatively similar to the ones with e = 0). 

• In the second case, we consider structured short-range connectivity, inspired by recent 
measurements 0, Q] . We put one excitatory and one inhibitory unit on each site of 
a square lattice with L rows and M columns, so that there will be N=LM excitatory 
units and N inhibitory units. Each inhibitory unit is connected only locally, to the 
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excitatory unit that is on the same site. Numbering the unit in a type- writer way, from 
to N-l, we connect the i-th excitatory unit to the excitatory and inhibitory units 
that are on the eight sites numbered i — 1 mod N,i + 1 mod N,i — M mod N,i + M 
mod N, i - M + 1 mod N, i + M - 1 mod N, i + M + 1 mod N, i - M - 1 mod N. 

Therefore, each elements of is 

jo/8 if\i — j\ mod N — 1 
jo/8 if|z-j| mod N = M 
jo/8 if | z - j| mod N = M ±1 



Jij 



otherwise 
Analogously Wij = Wo/8 if |z —j\ mod N = 1 or M or Mil, and is zero otherwise. 
Hij is /to if * = j and is zero otherwise. 

Notice that, apart from the units on the boundary, each unit is connected to its four 
nearest neighbors and to its four next-nearest neighbors. Furthermore the connection 
matrices J and W are Toplitz matrices so that eigenvectors are the Fourier basis 

UJ) = -4^ el2nn3/N (5) 



and eigenvalues, given the notation Jy = J(i — j) = J(x), can be easily calculated: 
j n = ^2^=0 J(x)cos(^nx), and analogously for W. The highest eigenvalue of J is 
jo (and Wo for W), corresponding to the eigenvector with n=0. H is diagonal and 
have all eigenvalues equal to ho- We investigate also the case of structured short- 
range connectivity with open boundary conditions. In such a case the eigenvectors 
and eigenvalues are not known analytically and have to be computed numerically. 

In experiments of Segev et al. |l] 3 networks are analyzed with different geometries 
and size: a small 50-cells with a quasi-lD 2mm x 50 fim geometry, medium 10 4 -cells 
networks, with a rectangular 2mm x 2 mm geometry, and a large 2 10 6 -cells network 
with a circular 11-mm-radius geometry. 

When L=M our lattice model describe the 2D square geometry, while when M=l and 
L=N there are only 2 connections for each site (left and right next neighbor sites) and 
the model describe the quasi- ID geometry used in the experiments. 

In both cases and , all the matrices J , W and H commute each other and share 
a common set of eigenvectors given by the Fourier basis in eq. 



In the next section the model dynamics is analyzed in terms of the eigenvectors and 
eigenvalues of the connection matrices. The procedure is the same for both the structured 
short range connectivity (j3J) and the long-range connectivity that we have considered, since 
in both cases we know analytically the eigenvectors and eigenvalues of the matrices. In the 
open boundary conditions case we compute the eigenvalues numerically. 



III. MODEL DYNAMICS 



Using vectorial notation, the dynamics of the model is described by the 2N components 
vector {u, v} Let's call {u, v} the fixed point determined by u = 0, v = with F(t) = 
0,F(t) = 0. 

Linearizing the equations (1 1121) around the fixed point {u, v}, eliminating v from the 
equations, and assuming noise to be only on the v units (f = 0), we get 

ii + (2a - J)u + [a 2 - aJ + HW)]u = — HF(t) (6) 

where u is now measured from the fixed point value u, and nonlinearity enters only through 
the redefinition of the elements of J H and W: Jijg' u (uj) — > J^, Hijg f u (vj) — > Hij and 
Wijg' u (iLj) — ► Wy. We use bold and sans serif notation (e.g. u, J) for vectors and matrices 
respectively. 

The fixed point (u, v) is stable if the homogeneous associate equation of the Eqn. (0) has 
only decaying solutions u. In particular, when J, H and W share the same set of eigenvectors 
£ n , denoting with j n , W n and h n their eigenvalues, the eigensolutions are 

Un = e A ^ n , (7) 

where 

= 2a - j n a/j w 2 - Ah n W n 

2 2 [ } 

and the stability condition is Re[A n ] < i.e., the real parts Re[A n ] of the eigenvalues A ra of 
the homogeneous system must be negative. The state vector u is a linear combination of all 
the eigenmodes, given by u = J2 n c n eXnt ^n + c - c - i n ^ ne absence of noise T = 0, therefore if 
all the n modes have A n = Re[A n ] < 0, and lm[A n ] = 0, the activity u simply decays toward 
the fixed point, stationary state (regime A). In regime A the isolated system is "quiet" and, 
each unit just fire randomly, each one uncorrelated with the others. Regime A corresponds 



to j n < 2a and j\ ~ 4h n W n . Besides the regime A, others interesting dynamic regimes 

can be considered. In the following we analyze two cases named respectively regime B and 

Re[A n ] < Vn 

regime C. The regime B arises when 

lm[A n ] =0 Vn but one. (call it n=0) 
It means that excitatory connections are such that jo < 2a and jg < 4hoWo . In this 

regime, in absence of noise the system (after a transient with damped oscillations) settles 
down to the stable fixed point. However as we will see later, spontaneous collective aperiodic 
oscillations are induced by noise. The activity in presence of noise is similar to the one 
observed in- vitro by Segev et al. at 0,5 mM Ca concentration. The regime C is present 

Re[A ] > 

when it exists at least an eigenvalue, let call it Ao, such that 

lm[A ] ^0 

It means that 2a < jo < ^/AhoWo- Therefore regime C occur only in a critical interval 
of excitatory connections strength, such that excitatory principal eigenvalue jo is greater 



then 2a but lower then \/4h Wo. In this regime spontaneous oscillations grows in the linear 
approximation. As one expect, the saturating nonlinearity stabilizes the limit cycle. The 
nonlinear model shows synchronous periodic activity spontaneously, as we will see later, 
similar to the experimental results observed at 1 mM Ca concentration. 



When j is so large that j > 2a and j > V^o^o the linear analysis predicts a divergence 
without oscillations. In this case strong nonlinear effects have to taken in consideration. It 
has been observed by numerical simulations (sec|V} that the system shifts to a new stable 
fixed point, around which oscillations are induced by noise. 

The extracellular Ca2+ is known to affect synaps e p robability of transmitter release 
I21I and the action potential firing threshold (see The parameter of interest J, H 

and W are actually products of connection strengths and gradients of the non-linear terms 
evaluated at the equilibrium position; calcium concentration may affect both terms. So the 
effects of extracellular Ca2+ concentration may be multiple. We model the increase of Ca 
concentration as an increase of the excitatory connection strengths. Modeling the increase of 
Ca concentration as an increase of excitatory connections J and W (or at least as an increase 
of the excitatory-to-excitatory connection strength J), then both the transitions observed 
experimentally from 0.5 mM to 1 mM and from lmM to 2 mM Ca concentration could be 
accounted by the model. Indeed while a small increase in Ca concentration (and therefore a 
small increase of jo w.r.t. a) induces a transition in the model from regime B to regime C, 
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a larger increase in Ca concentration (and therefore a larger increase of jo) make the model 
to go out of regime C. 



IV. REGIME B DYNAMICS AND STOCHASTIC RESONANCE EFFECTS 

Starting from Eqn. (jUJ) we first analyze the self-correlation function of excitatory unit i, 
Ci{t — if) = (ui(t)iii(t')) — (ui(t)) (ui(t)) and the average self-correlation function C(t — t') = 
jj^2iCi(t — if) in the regime B in presence of noise of amplitude Y. The PSD, i.e. the 
Fourier Transform C(u) of C(t — t'), is the sum of N contributions given by: 

*M - (») 

when the eigenvalues are real and negative A n = — l/r n , and by 

V ; 4(l + cu 2 r 2 ) [ l + r 2 (cu + cu ) 2 1 + r 2 (cu - cu ) 2J 

for the eigenvalue Ao = — l/ro+iuo, with tq > 0, ujq ^ 0. The contribution expressed by Eqn. 
© is peaked at u — 0, while the contribution given by Eqn. (fTUj) is peaked at uj close to co> 
(when tqujq < 1). In regime B the PSD has contributions also from Eqn. (|1U|). Therefore the 
linear analysis predicts that noise induces in the regime B a collective oscillatory behavior 
in the neurons activity. This collective oscillatory behavior correspond to a broad peak in 
the power-spectrum of the neurons activity near the characteristic frequency uj . 

We perform numerical simulations of the nonlinear network model with the long-range 
connectivity and with the short-range connectivity. The values of parameters has been 
chosen in such a way to satisfy the conditions for the regime B. Similar results have been 
obtained in the long-range connectivity case (fig. ^ |5J) and in the short-range connectivity 
model (fig. EI). Noise induces spontaneous oscillations that are synchronous because £ has 
real positive elements. FigC] shows the synchronous time behavior of the state variables 
Ui(t), and its power spectrum density, when noise is T = 0.0004 in the N=10 long-range 
connections model (eqOJ , in regime B. The signal Uj(i) looks aperiodic on long time scale, 
being decorrelated over long time scale by the noise. This spontaneous aperiodic synchronous 
activity mimic the spontaneous aperiodic synchronous activity observed under 0.5 mM Ca 
(and 2.0 mM Ca) concentration in [2j. We compute the Inter- Event-Interval (IEI) between 
two successive bursting events. A peak of all Ui with intensity above 0.7 is defined as a 
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synchronized bursting event. From the sequence t n , specifying the location of the nth event, 
we compute the IEI histogram shown in fig. |21 Fig|3Jb shows the IEI histogram of a short- 
range connectivity model (eqSJ) with N=100 in regime B with noise T = 0.001. Notably, 
both IEI are in a good agreement with the experimental one observed at 0.5 mM Ca (see 
fig. 5 of PJ ) • Both experimentally and in the model, the IEI shows a peak (at about 10 sec) 
with a very long tail (around 40-60 sec the histogram is still significantly non zero). 

Introduction of a sigmoidal nonlinearity g(u) does not change the linear approximation 
results drastically. Numerical simulations show that noise induces similar synchronous oscil- 



lowever 
We 
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latory activity both in the nonlinear system and in the linearized one (see Fig^b). 
some classes of nonlinearity can show Coherent Stochastic Resonance phenomena 
categorize the nonlinearity into 2 general classes (as in ^) in terms of how g u deviates from 
linearity near the fixed point u: 



class I: g u {ui) ~ — auf class II: g u {ui) ~ Ui + auf — bu\ (11) 

where a, h > 0, and Ui is measured from the fixed point value Ui. Class I and II nonlinearity 
differ in whether the gain g' u decreases or increases (before saturation) as one moves away 
from the equilibrium point, and will lead to qualitatively different behavior, as will be 
shown. Fig. 0]b shows the ratio R = C(uj q )/T between the output power at the characteristic 
frequency uq and the power of the noise T, versus the noise level, using the two nonlinear ities 
shown in fig0]a (dashed line for class I , solid line for class II), in a long-range connectivity 
model. Class II nonlinearity can enhance the ratio between the height of the PSD peak and 
the strength of noise, for a critical range of noise intensities. Solid line in Fig. H]b shows the 
typical maximum that has become the fingerprint of Stochastic Resonance phenomena [lj]| . 
Fig. 0]c shows that the oscillation frequency changes (slowly) with the noise level T. 



V. REGIME C DYNAMICS 



If the excitatory-to-excitatory connections are stronger, so that Re[A n= o] = a — jo/2 > 0, 
but not too strong, so that it is still lm[Ao] 7^ 0, then spontaneous oscillatory activity 
arises also without noise. In particular, spontaneous periodic oscillations arise in the linear 
approximation if Re[Ao] = and lm[Ao] 7^ 0, this is a critical point separating the regimes 
Re[A ] < 0, lm[A ] (regime B) and Re[A ] > 0, lm[A ] ^ (regime C). 
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In the regime C linear analysis predict synchronous periodic activity with diverging am- 
plitude, that becomes stable when nonlinearity is taken into account. We focus on class I 
nonlinearity (eq. ITTj) . when g u deviates from linearity near the fixed point u due to sat- 
uration. This case includes most standard sigmoids used in modeling, including logistic 
sigmoids, hyperbolic tangent and rounded threshold-linear models with a soft saturation at 
high input level. Equation (JUJ) then becomes 

[(a + d t ) 2 ]u - [(d t + t*)J - HV% u (u) = —HF(t) (12) 

where by g u (u) we mean a vector with components [g u (u)]j = g u {ui). 

Fig. El shows the simulation results of a long-range connectivity model in regime C, 
with and without noise. Fig^a shows the saturating function that we have used in our 
numerical nonlinear simulations for excitatory units. Simulation results of N=100 short- 
range connectivity model with M=L=10 in regime C, shown in Figd are in qualitative 
agreement with the long-range connectivity model results. As shown in Fig. ODa and Fig0a 
the noiseless nonlinear numerical simulations shows stable synchronous periodic oscillatory 
activity u. 

We check numerically that this spontaneous periodic oscillations behavior holds only 
for a particular range of parameters (regime C). For example, starting from the regime 
C parameters used in FigEl for lower excitatory connections (jo = 99.86 < 2a) we get 
regime B aperiodic oscillations, while increasing jO beyond the regime C range (e.g., at 



j = 103 > y/hoWo) the network jumps to a new stable fixed point (and it starts to oscillate 
around the new fixed point if there's noise). 

As shown in FigH3c and Fig0b the PSD in regime C has two high peaks at first and 
second harmonic of the periodic network activity, resembling the experimental results of 
P). Moreover has put in evidence experimentally the existence of a broad peak at low 
frequencies in the PSD, indicating long time positive correlations. Our model reproduces 
these results, indeed numerical simulations of regime C in presence of noise, with both type 
of connectivities, show a broad peak at low frequency in the PSD (see fig0d). The broad 
peak is absent when the noise is absent. The low frequency's behavior indicates a long time 
positive autocorrelation in the activity of the network. This behavior cannot be accounted 
by the IF model of Segev et al. (see fig. 3.c in ]]]). In order to compare the IEI behavior 
of our model in the two regimes, the IEI histogram for the noisy model in regime C has 
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been computed (see fig. |)J). It looks totally different from the IEI histogram in regime B. 
In the regime C, for both the long-range and short-range connectivity cases, the long time 
tail of the IEI disappears. There is only a narrow high peak corresponding to the period 
of the signal. Therefore, one prediction of our model is that the experimental IEI at ImM 
Ca concentration should have a high peak (periodicity) with a fast decay similarly to fig. 5 
(differently then at 0.5 mM Ca). 

A. Fading of periodicity at long times 

Another effect, put in evidence experimentally [2], is the decrease in time of the periodicity 
of the bursting activity under 1 mM Ca on the time scale of several minutes. According to 
Segev et al [2], this effect could be related with the possibility of network adaptation, that 
still need to be verified experimentally. 

In our model we identify two parametric changes which result in a decrease of the pe- 
riodicity, namely the increase of noise level and the depression of excitatory connections. 
The depression of the synapses, during the experiments, could be justified in the light of 
adaptation processes: shortly after 1 mM Ca is added the excitatory connections increases 
their efficacy, while several minutes after the system possibly adapt to the new concentration 
and the efficacy of connections decreases to the original values. Also an increase of the noise 
during time cannot be excluded in principle. Even though all conditions, like temperature 
and humidity, are kept constant during the experiment, an increase of the noise of the system 
is possible. 

So, according to our analysis, adaptation (which is related to the depression of the exci- 
tatory connections) is not the only possible explanation of the fading of periodicity observed 
experimentally, since simply an increase of the level of intrinsic noise is able to account for 
the observed fading of periodicity. 

To show this, we have computed numerically the PSD for different values of the noise 
and for different values of the excitation. The results are reported in fig. |H] and fig. 
respectively. In both the figures it is evident that a fading of periodicity (i.e., a decrease of 
the first and second harmonic peaks) occurs both when noise increases and when excitatory 
connections are depressed. Looking at Fig. IHlandElwe see that the two parametric changes 
(noise-change or excitatory connections decrease) can be discriminated since their effects on 
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the PSD are different at low frequency. In Fig. |H]we note that an increase of the level of 
noise leads to an increase of the broad peak at uj = 0. Instead in Fig. El it is evident that 
a depression of the excitatory connections eigenvalues j , W induces a decrease of both the 
high peaks and the broad peak at u — 0. 

However, the experimental results at present do not allow to discriminate between the 
two possible explanations because, as far as we know, there are not measurement of the low 
frequency PSD after the fading of periodicity occurring on the time scale of several minutes. 
It could also be that both the phenomena occur and contribute to the fading of periodicity. 

An indication that noise may changes during time comes from the work of T. Tateno 
[ri | showing the PSD of the activity of a rat cortical network after 12,18, and 58 days in 
vitro (DIV). While PSD at 12 DIV seems to correspond to a noiseless or low- noise system, 
the figures at 18 and 58 DIV brings to mind the possibility that the noise is increased 
(in particular a low frequency peak becomes visible, even though the lin-log scale doesn't 
highlight it). A strong decrease of periodic activity occurs as numbers of days increases. 



B. Phase-locking between excitatory and inhibitory population 

Besides the periodic synchronous bursting activity analyzed until now, our model can 
exhibit periodic but not synchronous bursting activity. This appear when there's a phase 
lock between neurons involved in the burst. Mathematically it is described by Ui(t) oc 
|£i|cos(u;ot — 4>i), We can describe both synchronous and phase-locked periodic activities 
cases by writing Ui(t) = ^e _ltJ0 * + c.c, taking the £j real in the first case and complex 

(6 = lCi| e1 ^) i n the second. 

A phase locked oscillation arises when the dominant eigenvector is complex. Fig. fTTJl 
shows spontaneous oscillatory activity in regime C with a phase shift fa = 20n /Ni, between 
all the units Ui involved in the oscillation. This is achieved using both positive and negative 
connections. Negative connections can be simply implemented via inhibitory interneurons 
with very short time membrane time constants. 

In all simulations of previous sections the excitatory activity is synchronous, while the 
excitatory population and inhibitory population periodic activity are phase locked, and 
the phase shift between the two ensemble depends from network parameters. In all the 
simulations of the previous figures the u(t) vs. v(t) phase shift is about few thousandths 
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of a period, in good agreement with the theoretical result arctg(u>o/a) coming from the 
linear approximation analysis of our model. In the experiments of Segev et al. DD all 
the oscillatory population (both excitatory and inhibitory) appear synchronous. Indeed the 
predicted phase-shift is so tiny that cannot be clearly distinguished from zero. 

VI. SUMMARY AND CONCLUSIONS 

In the present paper we analyzed the effect of uncorrelated white noise on the sponta- 
neous dynamics of the EI model. Firstly we study the evolution of the system in the linear 
approximation and put in evidence the existence of two different regimes, B and C. The tran- 
sition from B to C regime is induced by increasing the strength of the excitatory synapses. 
Then nonlinear corrections have been introduced numerically. The noise induces in the two 
regimes very different behaviors. In the regime B the presence of noise induces collective 
synchronous aperiodic oscillations in the neural activity. In this regime nonlinearity does 
not change the synchronous oscillatory activity but can induce stochastic resonance. 

In the regime C stable spontaneous periodic oscillations can arise only in presence of 
nonlinearity. The oscillations are present also in noiseless conditions. The noise produces a 
broad peak at low frequency and a fading of periodicity at high level of noise. 

The stochastic model presented is able to account for the experimental results of Segev et 
al. In particular it accounts for both the observed synchronous periodic regime (at 1.0 mM 
Ca concentration - regime C ) and aperiodic regime (at 0.5 mM and 2.0 mM Ca concentration 
- regime B), and transition from one regime to another. It accounts for the long time positive 
correlations of the bursting activity, the IEI and spectral features of the activity, and the 
observed fading of periodicity. 

All to all connection matrices whose elements are rescaled with N is a very simplified 
model that, even though useful for analytical calculations, is not realistic. Recent estimation 
of connectivity in in-vitro rat cortical networks has shown arborization of the neurons of 



1.2±0.5mm 2 |ll|. A more plausible connection matrix for our model therefore is a structured 
finite range connection structure. We have simulated a network of 100 excitatory and 100 
inhibitory units: each couple of excitatory and inhibitory units is placed in a square lattice. 
Apart from the units on the boundary, each excitatory unit is connected to its four nearest 
neighbors and to its four next-nearest neighbors. Inhibitory-to-excitatory connections H are 
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still local, with each inhibitory unit connected to only one excitatory unit. 

In this structured short-range connections framework we can also account for the size- 
independence of the activity network, Indeed Segev et a.. Q observe a sinrilaritv in the 
activity of different-size networks. In order to account for this invariance, they suggested 
that the networks have a self-regulation process that can be achieved, for example, by an 
adjustments of neural efficacies or neuronal firing threshold. However, the similarity of 
activity find a simple explanation in the scenario where each unit is connected only to other 
units that are within a critical radius. While in a all-to-all connection model, in order 
to keep the activity constant the strength of the connections should scale with the size of 
the model, in a short-range connection model the strength of connections should not scale 
with the network's size. In order to scale the strength of connections with the size of the 
network a sort of self-regulations should be invoked. In the short-range model we get the 
scale-invariant activity as a bonus. Indeed the strength of the principal eigenvalue depends 
on the number of connections for each unit in average, and not on the total number of units. 

According to our model, networks with one size too small with respect to the range of 
connections (such that boundary effects becomes relevant and affect the average number of 
connections for each unit) shows dissimilarity from the larger networks activity, at the same 
environment conditions (same Ca concentration, density, etc). 

Finally it is worth to mention two points. 

i) The occurrence of different regimes of activity in in-vitro cortical networks has been 

n n 

also shown in the recent work of Tateno et al. |U|. Fig. 6. a of pjj shows the PSD that we 
recognize as typical of regime C, while for example we recognize indications of a possible 
broad peak at low frequency in the PSD shown in fig. 6.b and 6.c. 

ii) The "anomalous" low frequency broad peak in the PSD of neural activity is not specific 
to cortical in-vitro networks, it has been observed in vivo, for example, in the pulse trains 
of nerve cells belonging to various brain structures (such as auditory nerve [25j and the 
mesencephalic reticular formation j^) and in IF models [^J. In [24| it has been related 
to the metastability of high activity patterns in the presence of noise (patterns that diffuse 
throughout the system). The "anomalous" peak has been also pointed out recently in the 
activity of the Suprachiasmatic nucleus It correspond to an "anomalous" behavior of 
the Fano factor at large times. We claim that in the Suprachiasmatic Nucleus neurons, as in 
the rat cortical cultures, the low frequency peak in the PSD is just the result of the interplay 
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between nonlinearity and the intrinsic noise. 
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FIG. 1: Numerical simulations of an long-range connectivity (eq|3j) model. The values of param- 
eters has been chosen in such a way to satisfy the conditions for the regime B. (specifically, a = 
50sec-\ N = 10, J i:j = | = fc^, Wij = W /N, H %3 = h 5(i - j), W = h = ^0.25^ + 0.25, 
so that ujq = a/— j'o/4 + h~oWo = 0.5rad/sec). a. Activation function g{u) used in simulations for 
excitatory units, u is measured from the fixed point value u, and g(u) is shifted vertically so that 
the fixed point coincides with the origin (0,0), marked by a cross, b. Power Spectrum Density 
of excitatory units activity, in regime B, with noise T = 0.0004. Stars are nonlinear simulations 
results, circles are linear simulations results, while solid line is theoretical prediction in linear ap- 
proximation. A broad peak at to ^ in the PSD is induced by noise, c. The time behavior of the 
state variable Ui(t),i = 1, . . . , iV in the linear numerical simulation in regime B, with T = 0.0004. 
Lines Ui(t), i = l,..,N = 10, overlaps each other because of synchrony. All units Ui(t) shows 
synchronous aperiodic oscillatory activity. 
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FIG. 2: a. Histogram of Inter Synchronous Event Intervals of the activity shows in previous figure 
(regime B with T = 0.0004). b. Zoom of the decay region of the IEI histogram. 
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FIG. 3: Numerical simulation of a noisy nonlinear square model with structured short-range 
connectivity in regime B, using periodic boundary condition (eq. 0J) (a&b) and open boundary 
conditions (c). N=100 excitatory and N inhibitory units are placed on a 10x10 square. The values 
of parameters has been chosen in such a way to satisfy the conditions for the regime B (specifically, 
a = 50sec -1 , N = 100, W = h = y/0.25j$ + 0.25, j = 2(a - 0.1), so that oj = 0.5rad/sec). a: 
The time behavior of excitatory activity Ui(t),i = 1, . . . , N in the model with periodic boundary 
condition. (Specifically parameters are Jjj = ^ and Wy = Wq/ '8 for — mod N = 1, M, Mil, 
and Hij = ho5(i — j), T = 0.001). b: Histogram of Inter Synchronous Event Intervals of the 
activity shown in a. c: The time behavior of excitatory activity Ui(t),i = 1, ... ,8 in the model 
with open boundary condition. Activity is synchronous, but with different amplitudes. Parameters: 
Jij = jo/7.75 and Wij = W /7.75 for \i-j\ = ±1, ±M, ±(M ± 1), zero otherwise, = h S(i-j), 
r = 0.04. 
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FIG. 4: Nonlinearity and stochastic resonance effects. Numerical simulations of a long-range 
connectivity model in regime B. a. Two activation functions for excitatory units U{. Dashed line 
shows a saturating activation function (class I, used in most of the following simulations), while 
solid line shows a class II nonlinear function whose slope increases before decreasing when u is 
raised from its stationary value (cross), b. Ratio R = PSD(ujo)/T as a function of the noise level 
T. Dashed line correspond to the class I activation function shown with dashed line in a, while 
the solid line to the solid line class II activation function. We used the following parameters in 
the simulations: N = 10, a = 50sec _1 = ^ = 9.98sec _1 , Wq = ho = 50.89.sec~ 1 , so that 
ujq = Wrad/sec. c. The frequency of the PSD peak versus the noise level (same simulations as in 
b). Effect of nonlinearity is evident in both fig. b and c, indeed for linear system R and ujq do not 
change with noise level. 
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FIG. 5: Regime C simulations of the nonlinear model with long-range connectivity (eq|3J). We 
use the following parameters N = 10, Jjj = % = 2 ^ aH ^ > '° 7 ^ , and Wo = ho = -y/0.25jQ + 0.25. 
The activation function for the excitatory unit is shows in FigQa. a,b: Time behavior of the 
state variables Ui(t), in the numerical simulation of the isolate EI long-range connectivity network 
in regime C. (Lines Ui(t), i = 1,..,10, overlaps each other because of synchrony), a: regime C, 
noiseless nonlinear system. Synchronous periodic oscillatory activity is shown, b: regime C, noisy 
nonlinear system with T = 0.01. The activity is almost periodic, but noise decorrelates the signal 
over long time scales, c: Power Spectrum Density of the activity shown in a (lin-log scale). The 
peaks in the first and second harmonic mark clearly the collective periodic activity. d:Log-log plot 
of the Power Spectrum Density of the activity in regime C at T = 0.01 (upper curve), T = 0.001 
(lower curve) and T = (inset). Noise induces a broad peak at low frequency. 
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FIG. 6: Histogram of Inter Synchronous Event Intervals, of the activity shown in figure 03b (non- 
linear model with long-range connectivity in regime C with T = 0.01 ) 
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FIG. 7: Numerical simulations of nonlinear model with short-range connectivity (JIJ) in regime C, 
using periodic boundary condition (a&b) and open boundary condition (c). N=100 excitatory and 
N inhibitory units are placed on a 10x10 square. The values of parameters has been chosen in such 
a way to satisfy the conditions for the regime C (specifically, N = 100, jo = 2(a + 0.07), Wq = 
ho = ^0.25^ + 0.25). a:Time behavior of the state variables Ui(t) (synchrony) in the periodic 
boundary condition connectivity case @. Specifically parameters are: = jo/8, W%j = Wo/8, 
for \i — j\ mod N = 1, M, Mil, Hij = ho$(i — j) ) b: PSD of the activity Ui{t) shown in a. c: 
Time behavior of the state variable Ui{t) for i = 1 ... 10 in the open boundary condition model. 
Activities of the units are synchronous but with different amplitudes. (Specifically parameters are 
Jij = jo/7.75, Wij = Wo/7.75, for \i - j\ = ±1, ±M, ±M ± 1, fly = h 6(i - j). ) 
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FIG. 8: a: Power Spectrum Density of the excitatory units activity of the noisy nonlinear networks 
with long-range connectivity in regime C, plotted at different noise levels. Black line: no-noise 
r = 0.0, red line: T = 0.0001 , green line: V = 0.001 , blue line: V = 0.01 , yellow line: V = 0.1. 
Noise make the high periodic activity fades away, b: Log-log plot of the Power Spectrum Densities 
shown in a. The two high peaks in the PSD correspond to the first and second harmonics of the 
activity period. The low frequency power spectrum distribution shows a broad peak in u = 0. 
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FIG. 9: a: Power Spectrum Density of the excitatory units activity of the noisy nonlinear long 
range networks, at T = 0.0001, plotted versus (3, jo = (3 + jo, Wo = 0+ Wo (where jo = 2(a + 0.07) 
and Wo = -y/0.25j'o + 0.25 correspond to regime C). Increasing (3 the excitatory connections become 
stronger. Decrease of (3 (i.e. decrease of excitation) make the high periodic activity fades away, 
b: Log-log plot of some of the Power Spectrum Densities shown in a. Blue line: (3 = 0.2 back 
line: (3 = 0, yellow line: (3 = —0, 2, magenta line: (3 = —0.5. The two high peaks in the PSD 
correspond to the first and second harmonics of the activity period. The low frequency power 
spectrum distribution shows a broad peak in to = that decreases when excitation ((3) decreases, 
fading away. 
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FIG. 10: Phase-lock oscillatory activity Ui(t), i = 1,...,5. N=100 excitatory and N inhibitory 
units are placed on a 10x10 square. Jij and Wij are positive when \i — j\ mod N = 1, M, M db 1 
and are negative when — mod N = 3, 3M, 3M ±1, all the other elements are null. Hij = hoSij 
as usual. The values of parameters has been chosen in such a way to satisfy the conditions for the 
regime C. 



25 



